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Abstract 

Background: It has been documented that variations exist in breast cancer treatment despite wide dissemination 
of clinical practice guidelines. The aim of this population-based study was to evaluate the impact of regional 
guidelines (Piedmont guidelines, PGL) for breast cancer diagnosis and treatment on quality-of-care indicators in the 
Northwestern Italian region of Piedmont. 

Methods: We included two samples of women aged 50-69 years with incident breast cancer treated in Piedmont 
before and after the introduction of PGL: 600 in 2002 (pre-PGL) and 621 in 2004 (post-PGL). Patients were randomly 
selected among all incident breast cancer cases identified through the hospital discharge records database. We 
extracted clinical data on breast cancer cases from medical charts and ascertained vital status through linkage with 
town offices. We assessed compliance with 14 quality-of-care indicators from PGL recommendations, before and 
after their introduction in clinical practice. 

Results: Among patients with invasive lesions, 77.1% (N = 368) and 77.5% (N = 383) in the pre-PGL and post-PGL 
groups, respectively, received breast conservative surgery (BCS) as a first-line treatment. Following BCS, 87.7% 
received radiotherapy in 2002, compared to 87.9% in 2004. Of all patients at medium-to-high risk of distant 
metastasis, 65.5% (N = 268) and 63.6% (N = 252) received chemotherapy in 2002 and in 2004, respectively. Among 
the 1 17 patients with invasive lesions and negative estrogen receptor status in 2002, hormonal therapy was 
prescribed in 23 of them (19.6%). The incorrect prescription of hormonal therapy decreased to 10.8% (N = 10) 
among the 92 estrogen receptor-negative patients in 2004 (p < 0.01). 

Compliance with PGL recommendations was already high in the pre-PGL group, although some quality-of-care 
indicators did not reach the standard. In the pre/post analysis, 8 out of 14 quality-of-care indicators showed an 
improvement from 2002 to 2004, but only 4 out of 14 reached statistical significance. We did not find any change 
in the risk of mortality in the post-PGL versus the pre-PGL group (adjusted hazard ratio 0.94, 95%CI 0.56-1.56). 

Conclusions: These results highlight the need to continue to improve breast cancer care and to measure 
adherence to PGL. 
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Background 

Evidence-based guidelines serve as a tool to ensure that 
patients receive treatment based on the best available 
evidence. In 1995, Sainsbury et al. postulated that the 
improvement of clinical practice in breast cancer treat- 
ment could increase 5-year survival by up to 10% [1]. 

In the Piedmont Region (Northwestern Italy, popula- 
tion 4.25 million), clinical practice guidelines (PGL) for 
the treatment of breast cancer were first released in July 
2002 and disseminated to all relevant clinicians and 
other stakeholders [2,3] Furthermore, as from 1996, the 
Piedmont Region has been covered by a breast screening 
program for all resident women aged 50-69 years. 

It has been well documented that there is considerable 
variation in breast cancer treatment despite wide dis- 
semination of clinical practice guidelines [4]. Variations 
are usually related not only to patient characteristics, 
such as age and educational level, but also to geographic 
area of residence and hospital and physician characteris- 
tics [5]. 

Although several studies have examined the different 
surgical and medical breast cancer treatments employed 
following the publication of clinical practice guidelines, 
to our knowledge few reports have included a compari- 
son with clinical practice prior to guideline publication, 
and even fewer have examined the impact of guidelines 
in clinical practice at a population level [6,7]. 

To evaluate the real impact of PGL on breast cancer 
treatment in Piedmont, we collected data from the 
medical charts of women with breast cancer aged 
50-69 years to assess compliance with 14 quality-of-care 
indicators, based on PGL recommendations, before and 
after the introduction of PGL in clinical practice. Fur- 
thermore, we explored the use of post-surgical medical 
treatment, including radiotherapy, chemotherapy and 
hormonal therapy in the two periods, according to FIGO 
stage, lymph node involvement and hormone receptor 
status. Finally, we compared the survival rates of patients 
treated before and after the introduction of PGL. 

Methods 

Population and data sources 

The Piedmont hospital discharge records (HDR) data- 
base was used to identify female patients with incident 
breast cancer, aged 50-69 years, residing in Piedmont 
and surgically treated in 2002 and 2004 at regional 
hospitals. In 2002 we identified 1,764 female patients, of 
whom 866 underwent surgical treatment in the first 
6 months of 2002. Among these 866 patients, 600 were 
randomly selected for this study (pre-PGL group). In 
2004, 1,777 female patients were identified, of whom 
905 underwent surgical treatment in the first 6 months 
of 2004. Among those 905 patients, 621 were randomly 
selected for this study (post-PGL group) (Figure 1). The 



start of the post-PGL period was 1.5 years after the 
introduction of PGL, as at this time they were likely to 
have been implemented in Piedmont hospitals. 

We did not include prevalent breast cancer cases, 
i.e., women who had been previously hospitalized for 
breast cancer and were recorded in the Piedmont 
Cancer Registry and/or were in the HDR database 
between 1998 and 2002. 

For the purposes of this study, breast cancer was defined 
by the following International Classification of Diseases 9 th 
Revision - Clinical Modification (ICD9-CM) codes: 174, 
carcinoma of the breast; 233.0, in situ carcinoma of the 
breast; 238.3, neoplasm of uncertain behavior of the breast; 
or 239.3, neoplasm of unspecified nature of the breast, in 
any position of the HDR database. 

Fifty-eight patients from the randomly-selected pre- 
PGL group and 71 patients from the randomly-selected 
post-PGL group were not eligible for inclusion as they 
had benign lesions, prevalent lesions, recurrences, other 
cancers, no surgical treatment, or unavailable clinical 
records. After exclusion, 542 patients were left in the 
pre-PGL group and 550 in the post PGL-group, and 
were included in the following analyses (Figure 1). 

In situ carcinomas of the breast were over-sampled in 
both groups. To do this, the same inclusion criteria were 
applied, but were not restricted to the first 6 months of 
2002 and 2004. Instead, all women with in situ carci- 
noma (ICD9-CM code 233.0) who were surgically 
treated at any time in 2002 and 2004 were included. The 
total number of oversampled patients with in situ lesions 
was 121 in 2002 and 108 in 2004. This over-sampling 
was only used in the analyses concerning the indicators 
for patients with carcinoma in situ (CIS) in order to 
increase the power of the study. 

The accuracy of the method adopted to identify inci- 
dent breast cancer cases was validated using data from 
the Piedmont Cancer Registry, which covers about 20% 
of the regional population [8], as a gold standard. The 
sensitivity of the algorithm was 76.7% for breast cancer 
and the positive predictive value was 92.6%. 

Follow-up of patients from both groups was performed 
through linkage to different databases using two hierar- 
chical linkage keys. The HDR database was used to identify 
all subsequent relevant hospitalizations (2002-2005) for 
other surgical treatments (on the same, or other lesions), 
medical complications and chemotherapy sessions. Radio- 
therapy was assessed through linkage with the radiotherapy 
outpatient record database (which also includes extra- 
regional radiotherapy records), and hormonal therapy was 
assessed though linkage to the pharmaceutical prescription 
record database (which includes all drug prescriptions 
reimbursed to patients by the public health system). 

All clinical records of any surgical or radiotherapy 
hospitalization identified for patients in the HDR 
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Breast cancer cases 
Piedmont Region 2002 
Age 50-69 years 
N incident cancers=1764 
N prevalent cancers=1 1 1 



Breast cancer cases 
Piedmont Region 2004 
Age 50-69 years 
N incident cancers=1777 
N prevalent cancers=117 



Surgery in first 6 months of 2002 
N incident cancers=866 



Surgery in first 6 months of 2004 
N incident cancers=905 



Randomly-selected study sample: 
N=600 

(Invasive lesions =521 
In situ =25 
Neoplasm of uncertain behaviour =35 
Neoplasm of unspecified nature =19) 



Randomly-selected study sample: 
N=621 

(Invasive lesions =559 
In situ =28 
Neoplasm of uncertain behaviour =22 
Neoplasm of unspecified nature =12) 



Data from clinical records evaluation: 



Study population 
N=542 







Not eligible: 






30 


Benign lesion 32 






17 


Prevalent lesions 32 






2 


Recurrences 4 






2 


Other cancers 1 






0 


No surgery 2 




7 


Not available clinical records 


0 



Main lesion: 




Invasive 
lesions 



N=468 
86.3% 



Microinvasive 
lesions 



N=9 
1.7% 



in situ 
lesions 



N=65 
12.0% 



Invasive 
lesions 



N=479 
87.1% 



Microinvasive 
lesions 



N=15 

2.7% 



In situ 
lesions 



N=56 
10.2% 



Figure 1 Study population of women with incident breast cancer who underwent surgery in 2002 and 2004. 



database were retrieved. The clinical data were 
extracted from medical charts by two breast cancer 
screening technicians supervised by a gynecologist 
and an epidemiologist, working independently of the 
practitioners caring for patients in different hospitals. 
It was impossible to extract data blinded to the year 
of treatment since the data were obtained directly 
from the patients' records. To control the extracted 
data, a random 10% sample was rechecked by the 
supervisors, blinded to the previous decisions. The 
collected data were entered into a database previously 
used for clinical audit (the Audit System on Quality 
of Breast Cancer Treatment), developed by a multi- 
disciplinary team from the European Breast Cancer 
Network [9]. 

The ascertainment of vital status was carried out 
through linkage with town offices, identifying the date 
of death and allowing for the retrieval of the death 
certificate to identify the specific causes of death 
(2002-2010). All procedures concerning death certi- 
ficates, data collection and coding were applied 
uniformly to both groups. 



Main outcome measures 

Fourteen quality-of-care indicators were chosen to evalu- 
ate the impact of PGL (Table 1). We explored the use of 
the sentinel lymph node (SLN) technique by surgical unit 
annual case load, to measure the introduction of this pro- 
cedure. Finally, we investigated post-surgical medical 
treatment, including chemotherapy among patients with 
invasive lesions at low/medium to high risk of distant 
metastasis (according to the Goldhirsch scheme) [10], and 
hormonal therapy prescribed according to estrogen recep- 
tor status. 

Statistical analyses 

The differences in distribution between post-PGL and 
pre-PGL breast cancer cases according to patient, tumor 
and surgical unit characteristics and in the rates of 
patients receiving post-surgical medical treatment were 
assessed by two-way Chi square Test or Fisher Exact Test. 

The 14 quality-of-care indicators (Table 1) were ana- 
lyzed as dichotomous variables by multivariable logistic 
regression models, using the period (post-PGL versus 
pre-PGL) as the main effect and controlling for 
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Table 1 Piedmont Region clinical practice guidelines quality-of-care indicators 



Level of evidence (AHRQ 
grade of underlying 
recommendation) 


Quality-of-care indicators 


Function 


Quality-of- 
care 
standards 


B 


% of malignant lesions with 
cytological or histological pre- 
operative diagnosis 


Calculates the proportion of patients with invasive or in situ 
lesions with a pre-operative cytological or histological diagnosis 
(C5 or B5), out of the total number of patients with invasive or in 
situ lesions who underwent surgical treatment. 


> 70% 


A 


% BCS in pTI, unifocal 


Calculates the proportion of patients diagnosed with invasive 
lesions of a pathological size of <20 mm (pTI, microinvasive 
included), not clinically multicentric or multifocal, who were 
treated with BCS. 


> 80% 


B 


% BCS with free margins (>1 mm) 


Calculates the proportion of BCS (last BCS if more than one) for 
invasive or in situ lesions which ensured clear margins (distance 
>1 mm from the lesion), out of the total number of BCS 
performed. 


/ 


/ 


% single surgery after diagnosis 


Calculates the proportion of patients whose first surgical 
treatment was not followed by further local operations that were 
required due to incomplete excision (excluding failed biopsies), 
out of the total number of patients who were surgically treated 
for localized invasive or in situ lesions with a positive or 
suspicious cytological or histological pre-operative diagnosis. 


/ 


C 


% frozen section in lesions <10 mm 


Calculates the proportion of patients surgically treated for 
invasive lesions (excluding microinvasive lesions) of a maximum 
pathological size <10 mm for which there was no frozen section, 
out of the total number of patients with the same diagnosis. 


> 95% 


A 


% of patients with invasive lesions 
treated with axillary clearance or 
SLN technique 


Calculates the proportion of patients with invasive lesions who 
were treated with axillary dissection or SLN technique, out of the 
total number of patients with invasive lesions. 


/ 


C 


% of patients treated with axillary 
clearance with >9 lymph nodes 


Calculates the proportion of patients with invasive lesions who 
were treated with axillary clearance (level l-lll), excluding 
sampling, and from whom at least 10 lymph nodes were excised, 
out of the total number of patients with invasive lesions who 
were treated with axillary clearance. 


> 95% 


C 


% with NO dissection among CIS 
patients 


Calculates the proportion of patients diagnosed with CIS or not 
otherwise specified in situ lesions (microinvasive cancer excluded) 
on whom no axillary dissection was performed (not even level I) 
out of the total number of patients with this diagnosis who were 
surgically treated. 


> 95% 


C 


% correct SLN identification 


Calculates the% of SLN identified out of the total of identified 
SLN in patients with invasive lesions, who were treated with SLN 
technique. 


> 90% 


C 


% histopathological grading 
available 


Calculates the proportion of patients with invasive lesions 
(excluding microinvasive cancer) who were surgically treated and 
for whom measuring was provided, out of the total number of 
patients with invasive lesions who underwent surgical treatment. 


> 95% 


C 


% hormonal receptor availability 


Calculates the proportion of patients with invasive lesions 
(excluding microinvasive cancer) who were surgically treated and 
for whom measuring was provided, out of the total number of 
patients with invasive lesions who underwent surgical treatment. 


> 95% 


/ 


% immediate reconstruction after 
mastectomy 


Calculates the proportion of patients with invasive or in situ 
lesions who had mastectomies and immediate reconstruction, 
out of the total number of patients treated with mastectomy. 


1 


A 


% radiotherapy in patients treated 
with BCS 


Calculates the proportion of patients who were treated with BCS 
for invasive or in situ lesions, and for whom radiotherapy 
followed, out of the total number of patients with the same 
diagnosis who were treated with BCS. 


> 95% 


A 


% of eligible patients that receive 
hormonal therapy 


Calculates the proportion of patients with invasive lesions and 
positive estrogen receptors who received hormonal therapy. 


/ 



AHRQ grade of underlying recommendation (reference http://archive.ahrq.gov/clinic/epcarch.htm), BCS: breast conservative surgery, pTI: small primary tumor, 
SLN: sentinel lymph node, CIS: carcinoma in situ. 



Sacerdote et al. BMC Health Services Research 2013, 13:28 
http://www.biomedcentral.com/1472-6963/13/28 



Page 5 of 1 2 



Table 2 Distribution of breast cancer cases according to various patient, tumor and surgical unit characteristics, 2002 
and 2004, Piedmont Region, Italy 



N and% of patients 
2002 2004 



Effect of year 
(p value) 



Sample size (N) 
Age (years) 

50-54 
55-59 
60-64 
65-69 
Missing 

Educational level 

Bachelor 

Secondary 

Professional 

Intermediate and primary 
None and unknown 
Pathological T stage 

In Situ 
1 mic 
1 

la 

lb 

1c 

2 

3 

4 

4a 

4b 

4c 

4d 

X 

Missing 

Pathological N stage 

0 

Sentinel lymph node 
1 

la 

lb 

Ibl 

1b2 

1b3 

1b4 

2 

3 

X 

Missing 



542 (49.6%) 

1 34 (24.7%) 
1 1 1 (20.5%) 
166 (30.6%) 
131 (24.2%) 
0 

69 (12.7%) 
151 (27.9%) 
222 (40.9%) 
85 (15.7%) 
1 5 (2.8%) 

62 (11.4%) 

10 (1.8%) 

4 (0.7%) 

1 7 (3.2%) 
75 (13.8%) 

1 86 (34.3%) 
147 (27.2%) 

5 (0.9%) 
5 (0.9%) 

3 (0.6%) 

1 8 (3.3%) 

1 (0.2%) 

2 (0.4%) 

4 (0.7%) 

3 (0.6%) 

205 (43.3%) 
80 (16.9%) 
21 (4.4%) 
20 (4.2%) 
7 (1.5%) 
40 (8.4%) 
7 (1.5%) 
56 (11.8%) 

11 (2.3%) 
1 5 (3.2%) 
0 

9 (1.9%) 
2 (0.4%) 



550 (50.4%) 

1 24 (22.5%) 
1 22 (22.2%) 
151 (27.5%) 
1 53 (27.8%) 
0 

99 (18.0%) 
146 (26.5%) 
1 97 (35.8%) 
88 (16.0%) 
20 (3.6%) 

55 (10.0%) 
1 5 (2.7%) 
5 (0.9%) 
25 (4.5%) 
85 (15.5%) 
1 89 (34.4%) 
1 36 (24.7%) 
10 (1.8%) 

5 (0.9%) 
0 (0%) 

1 5 (2.7%) 
0 (0%) 
2 (0.4%) 

2 (0.4%) 

6 (1.1%) 

158 (31.3%) 
167 (33.1%) 
37 (7.3%) 
72 (14.3%) 

3 (0.6%) 

2 (0.4%) 

3 (0.6%) 
3 (0.6%) 
3 (0.6%) 
25 (5.0%) 
23 (4.6%) 
6 (1 .2%) 
2 (0.4%) 



0.35 



0.54 



<0.01 
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Table 2 Distribution of breast cancer cases according to various patient, tumor and surgical unit characteristics, 2002 
and 2004, Piedmont Region, Italy (Continued) 



Pathological TNM stage 

In situ 



III or more 
Missing 

Grading (invasive only) 

Low 

Intermediate 

High 

Not performed and missing 

Disease detected through regional screening program 

Yes 

No, symptomatic 
No, asymptomatic 
Missing 

Surgical unit annual case load 

< 50 
50-149 
> 150 
Missing 



65 (12.0%) 
1 89 (34.8%) 
1 27 (23.4%) 
75 (13.8%) 
47 (8.8%) 
39 (7.2%) 

58 (12.0%) 
69 (14.4%) 
103 (21.5%) 
250 

208 (38.4) 

209 (38.6%) 
110 (20.3%) 
1 5 (2.8%) 

1 24 (22.9%) 
249 (45.9%) 
1 55 (28.6%) 
14 (2.6%) 



56 (10.2%) 
233 (42.3%) 
1 1 2 (20.4%) 
53 (9.6%) 
65 (11.9%) 
31 (5.6%) 

82 (16.5%) 
86 (17.4%) 
89 (18.4%) 
238 

236 (42.9%) 
171 (31.9%) 
1 1 2 (20.4%) 
31 (5.6%) 

1 26 (22.9%) 
250 (45.5%) 
147 (26.8%) 
27 (4.8%) 



0.04 



0.09 



0.001 



0.001 



confounders (age, educational level, clinical stage, screen- 
ing provenience and surgical unit annual case load). The 
results are presented as frequencies, adjusted odds ratios 
(OR a dj) and 95% confidence intervals (95%CI) estimated 
from logistic models to measure the probability of achie- 
ving standards in 2004 compared to 2002. We performed 
Cox proportional hazards regression analyses to study 
survival. Proportional hazard assumptions were tested with 
the Grambsch and Therneau test before analysis. Statistical 
analyses were performed using SAS 8.2 and STATA vlO. 

Results 

Patient characteristics 

Among the women included in the analyses, the distribu- 
tion by type of lesion in the pre-PGL group was: 88.0% 
invasive or microinvasive (N = 477) (ICD9-CM code 174), 
and 12.0% in situ (N = 65) (ICD9-CM code 233.0); in the 
post-PGL group it was 89.8% invasive or microinvasive 
(N = 494), and 10.2% in situ (N = 56) (non-statistically 
significant difference) (Table 1). 

Table 2 shows the distribution of breast cancer cases by 
patient, tumor and care provider characteristics for the pre- 
PGL and post-PGL groups. Both groups had similar age 
and educational level distribution. In contrast, there was a 



statistically significant difference in the distribution of 
clinical stages between 2002 and 2004. The proportion of 
cases diagnosed through the regional screening program 
increased from 38.4% (N = 208) in 2002 to 42.9% (N = 236) 
in 2004 (p = 0.001). Of all patients diagnosed with CIS, the 
percent diagnosed by the regional screening program 
increased from 45.9% (N = 28) in 2002, to 63.6% (N = 35) 
in 2004 (data not shown). The annual case load of surgical 
units was stable over the two periods (Table 2). 

Surgical and medical treatment 

In the pre-PGL group 77.1% (N = 368) of patients with 
invasive lesions received BCS as a first-line treatment, and 
for 62.7% (N = 299) of patients in the pre-PGL group, BCS 
was a definitive surgical treatment. In the post-PGL group 
the numbers were 77.5% (N = 383) and 66.6% (N=329), 
respectively (Figure 2). 

As for post-surgical medical treatment, following BCS, 
87.7% (N = 341) of the pre-PGL group and 87.9% 
(N = 362) of the post-PGL group received radiotherapy 
alone, or in combination with chemotherapy (Figure 3). 
Post-surgical treatment with adjuvant chemotherapy was 
received by 50.9% (N = 276) of the pre-PGL group (about 
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2002 



Invasive and microinvasive 
lesions 
N=477 
88.0% 




In situ lesions 
N=65 
12.0% 



Mast 
N=5 

7.7% 



BCS 
N=58 
89.2% 



No other surgery 
N=43 
74.2% 



2004 



Invasive and microinvasive 
lesions 
N=494 
89.8% 



1 st surgery 



Other or 
unknown 
N=2 
3.1% 




Mast 
N=108 
21.9% 



BCS 
N=383 
77.5% 



Other or 
unknown 
N=3 
0.6% 



No other surgery 
N=329 
85.9% 



2 surgery 




in situ lesions 
N=56 
10.2% 



Mast 
N=5 
8.9% 



BCS 
N=51 
91.1% 



No other surgery 
N=42 
82.3% 



Other or 
unknown 
N=0 
0.0% 




Other 




Mast 




Other 




Mast 




Other 




Mast 




Other 




Mast 


BCS 




N=31 




BCS 




N=8 




BCS 




N=18 




BCS 




N=6 


N=38 




8.4% 




N=7 




13.8% 




N=36 




4.7% 




N=3 




11.9% 


10.3% 








12.0% 








9.4% 








5.8% 







Mast: mastectomy, BCS: breast conservative surgery. 

Figure 2 Surgical treatment in women with incident breast cancer who underwent surgery during the first 6 months of 2002 
and 2004. 



46% following BCS and 67% following mastectomy) and by 
46.2% (N = 254) of the post-PGL group (about 39% follow- 
ing BCS and 69% following mastectomy) (data not shown). 

Post-surgical medical treatment of invasive lesions is 
shown in Tables 3 and 4. Of all patients with invasive 
lesions at medium-to-high risk of distant metastasis, 
64.6% received chemotherapy (N = 520): 65.5% in the pre- 
PGL group and 63.6% in the post-PGL group. Among 
113 women with invasive lesions at low risk of distant 
metastasis 14.3% and 1.4% received chemotherapy in 2002 
and 2004, respectively (Table 3). 

Hormonal therapy was prescribed to 684 out of 901 
(75.9%) patients with invasive lesions. Of women who 
were prescribed hormonal therapy, 4.8% (N = 33) had 
negative estrogen receptor status. The incorrect pre- 
scription of hormonal therapy in patients with negative 
receptor status decreased from 19.6% (N = 23) in 2002 
to 10.8% (N = 10) in 2004 (p<0.01) (Table 4). 

Compliance with PGL recommendations 

Univariate analysis showed that compliance with PGL 
recommendations was already high in the pre-PGL 
group. Indeed, five of nine quality-of-care indicators did 
not achieve the proposed standard (% of malignant 
lesions with cytological or histological pre-operative 
diagnosis, % frozen section in lesions < 10 mm,% of 
patients treated with axillary clearance with > 9 lymph 



nodes, % with no dissection among CIS patients, % 
radiotherapy in patients treated with BCS). 

In the pre/post analysis, studying the probability of 
achieving standards in 2004 compared to 2002, although 
eight of the 14 examined quality-of-care indicators changed 
in the expected direction, only four indicators improved 
substantially from 2002 to 2004: percent of malignant 
lesions with cytological or histological diagnosis before sur- 
gery (OR adj 0.64, 95% CI 0.49-0.85), percent of BCS in pTl 
lesions and percent of BCS performed with free margins 
(OR adj 0.41, 95% CI 0.22-0.75 and OR adj 0.65, 95% CI 
0.41-1.01 respectively) and percentage of frozen section in 
lesions < 10 mm (OR adj 0.32, 95% CI 0.16-0.65). The other 
indicators were stable in the two periods (Table 5). 

The number and percent of women treated with SLN 
technique by surgical unit annual case load is shown in 
Table 6. The PGL recommendations said that the SLN 
technique should be performed, as an alternative to axil- 
lary dissection, only by surgical units with a high annual 
case load. The percent of patients who were treated with 
SLN technique by a surgical unit with an annual case 
load of < 50 (based on the total number of women who 
underwent surgery in low-case load units) was 19.1% in 
2002 (N = 25) and 42.3% in 2004 (N = 55). There was a 
big increase from 2002 to 2004 in the use of this tech- 
nique across all strata of annual surgical case load, but 
we observed the biggest increase in the lowest category 



Sacerdote et al. BMC Health Services Research 2013, 13:28 
http://www.biomedcentral.com/1472-6963/13/28 



Page 8 of 12 



2002 Definitive 2004 

surgery 



BCS 
N=389 



Mast 
N=146 



BCS 
N=412 



Mast 
N=137 



RT only 
N=172 
44.2% 



RT+ CT 
N=169 
43.4% 



CT only 
N=9 
2.3% 




RT+ CT 
N=30 
20.4% 



CT only 
N=68 
46.6% 



RT only 
N=214 
51.9% 



RT+ CT 
N=148 
36.0% 



CT only 
N=12 

2.9% 



RT only 
N=10 
7.3% 



RT+CT 
N=36 
26.3% 



Some treatment: N=350 (90%) 
No treatment: N=39 (10%) 



Some treatment: N=1 00 (68.5%) 
No treatment: N=46 " (31 .5%) 

"One patient refused CT treatment. 



Some treatment: N=374 (90.8%) 
No treatment: N=38 (9.2%) 



Some treatment: N=104(75.9%) 
No treatment: N=33(24.1%) 



BCS: breast conservative surgery, Mast: mastectomy, RT: radiotherapy, CT: chemotherapy. 

Figure 3 Post-surgical medical treatment in women with incident breast cancer who underwent surgery during the first 6 months of 
2002 and 2004. 



(annual case load < 50 = 55% increase, 50-149 = 40% 
increase, > 150 = 41% increase) (Table 6). 

Survival analyses 

Between 2002 and 2010, a total of 101 deaths were identified: 
52 women in the pre-PGL and 49 in the post-PGL group 
(90.4% and 90.1% crude 5-year survival, respectively). 

We did not find any change in the risk of mortality in 
the post-PGL versus the pre-PGL group (HR 0.94, 95%CI 
0.56-1.56 adjusted for age, clinical stage and surgical unit 
annual case load). 

Discussion 

This study evaluated compliance with PGL for breast 
cancer by comparing cases treated before and after their 
introduction. Patient and tumor characteristics were 
comparable between pre-PGL and post-PGL patients 
and the same methods of ascertainment and data collec- 
tion were used. 

Table 3 Post-surgical chemotherapy by risk of distant 
metastasis according to ER and lymph node status, 2002 
and 2004, Piedmont Region, Italy 



Low Risk* Medium-to-high risk§ 

N and % N and % 



P 

value 



2002 


6/42 


268/409 


0.04 




(14.3%) 


(65.5%) 




2004 


1/71 


252/396 






(1.4%) 


(63.6%) 





ER: estrogen receptor. 

* ER-positive and size < 2 cm and grading=1 with negative lymph node status. 
§ ALL patients with positive lymph node status or estrogen receptor-negative 
or size > 2 cm or grading > 2 regardless of lymph node status. 



In a previous report we investigated the distribution, 
implementation and evaluation of PGL among clinicians 
who treat breast cancer in the Piedmont Region. We 
found that approximately 90% of surgeons, gynecolo- 
gists, oncologists and radiologists working in the field 
(70.2% of those who responded to the questionnaire), 
were aware of PGL within 1 year of their release, and 
generally had a positive attitude to change their practice 
accordingly [3]. 

In this population-based study we examined clinical 
practice patterns before and after the introduction of 
PGL. We and observed good compliance with PGL 
before their release, and a weak increase in the number 
of medical decisions that complied with them after their 
release. 

The literature contains several examples of situations 
in which clinical practice guidelines on breast cancer 
treatment contributed to an improvement in quality of 
care [6,7,11,12], but very few of them included a compari- 
son of clinical practice prior to the release of the guidelines 
[6], or examined this practice at a population level [7]. 



Table 4 Post-surgical hormonal therapy in patients with 
invasive lesions according to estrogen receptor (ER) 
status, 2002 and 2004, Piedmont Region, Italy 

P 

value 



Estrogen 
receptor-positive 



Estrogen 
receptor-negative 





N and % 


N and % 




2002 


319/338 


23/1 1 7 


< 0.01 




(88.0%) 


(19.6%) 




2004 


332/354 


10/92 






(89.8%) 


(10.8%) 
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Table 5 Achievement of Piedmont Region clinical practice guidelines quality-of-care standards in 2002 and 2004, and 
effects of year. Piedmont Region, Italy 



Results 



2002 



2004 



Effect of year (adjusted* OR and 95%CI) 
2002 vs 2004 



N and % Missing N and % Missing 



/0 Ul 1 1 Idlly 1 lal 11 ICblUIlj Willi LyLUIUyiLdl Ul 


297/513 


48 


329/495 


65 


U.O+ \J.OD) 


histological pre-operativ& diagnosis 


(57.9%) 


(8.6%) 


(66.5%) 


(1 1 .6%) 




% BCS in pT1, unifocal 


231/268 


0 


253/272 


0 


0 41 (011-07^ 




(86.2%) 




(93.0%) 






% BCS with free margins (> 1 mm) 


312/368 


33 


348/387 


33 


0.65 (0.41-1.01) 




(84.8%) 


(8.2%) 


(89.9%) 


(7.9%) 




% single surgery after diagnosis 


332/369 


4 


342/376 


8 


1.02 (0.24-5.91) 




(90.0%) 


(1.1%) 


(91.0%) 


(2.1%) 




% frozen section in lesions < 10 mm 


55/97 


1 


85/113 


0 


0.32 (0.16-0.65) 




(56.7%) 


(1.0%) 


(75.2%) 






% of patients with invasive lesion treated 


433/468 


0 


460/478 


1 


0.28 (0.10-0.85) 


with axillary clearance or SLN technique 


(92.5%) 




(96.2%) 


(0.2%) 










% of patients treated with axillary 


317/336 


4 


245/268 


4 


1.71 (0.89-3.31) 


clearance with > 9 lymph nodes 


(94.3%) 


(1.2%) 


(91.4%) 


(1.5%) 






% with NO dissection among CIS patients** 


115/123 


0 


98/1 04 


0 


0.60 (0.14-2.50) 




(93.5) 




(94.2%) 






% correct identification of SLN 


1 1 8/1 26 


30 


215/219 


54 


0.46 (0.18-1.05) 




(93.6%) 


(1 9.2%) 


(98.2%) 


(1 9.8%) 




% histopathological grading available 


455/462 


18 


466/469 


17 


0.34 (0.08-1.42) 




(98.5%) 


(3.7%) 


(99.4%) 


(3.5%) 




% hormonal receptor availability 


455/471 


9 


446/473 


13 


1 .80 (0.94-3.48) 




(96.6%) 


(1 .8%) 


(94.3%) 


(2.7%) 




% immediate reconstruction after mastectomy 


41/154 


■-1 


30/137 


2 


1.16 (0.63-2.16) 




(26.6%) 


(2.5%) 


(21.9%) 


(14%) 




% radiotherapy in patients treated with BCS 


341/389 


0 


362/412 


0 


1.01 (0.60-1.5) 




(87.7%) 




(87.9%) 






% of eligible patients that receive hormonal therapy 


319/338 


0 


332/354 


0 


1.01 (0.69-1.42) 




(94.3%) 




(93.8%) 







The 2004 period is the reference category for the estimation of ORs. 

*Adjusted for age, educational level, clinical stage, screening provenience and surgical unit annual case load. 
**Calculated on CIS lesions over-sampled group. 

OR: odds ratio, BCS: breast conservative surgery, pTI: small primary tumor, CIS: carcinoma in situ, SLN: sentinel lymph node. 



In 1997, Ray-Coquard and collaborators [6] conducted 
a study in France on 200 patients, with a before/after 
design, using information from medical records, and 
suggested significant changes in the quality of care. 
These changes were probably due to the introduction of 
clinical practice guidelines, but their results needed 
confirmation in a larger sample of cases. 

White and collaborators [7] performed a study in 
Victoria, Australia in 2004 with a similar design using 
mailed questionnaires. All cases of early breast cancer 
registered in the Victorian Cancer Registry during two 



6-month periods were selected and a questionnaire was 
sent to the relevant surgeon about patient characteristics 
and primary treatments. The study showed an improve- 
ment in quality of care after the introduction of clinical 
practice guidelines. However the study included data 
provided directly by surgeons from two different surveys. 
Significantly more surgeons completed the questionnaire 
in the first survey (73%) than in the second one (52%). 
The difference in the response rate between the two 
surveys could have introduced bias, causing a selection of 
those most interested in the topic, i.e., the surgeons with 
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Table 6 Surgical treatment with sentinel lymph node 
technique according to surgical unit annual case load, 
2002 and 2004, Piedmont Region, Italy 

Surgical unit Sentinel lymph node technique 





N and % 


Missing 


N and % 


Missing 


< 50 


25/131 


3 


55/130 


3 




(19.1%) 


(2.2%) 


(42.3%) 


(2.2%) 


50-149 


67/244 


/ 


113/250 


1 




(27.4%) 


(2.8%) 


(45.2%) 


(0.4%) 


> 150 


55/146 


8 


95/149 


0 




(37.7%o) 


(5.2%) 


(63.7%) 




Overall 


147/521 


21 


263/529 


21 




(28.2%) 


(3.9%) 


(49.7%) 


(3.8%) 



the highest case load [13]. Furthermore, answers furnished 
by the physicians could have reflected not necessarily what 
they did in their clinical practice, but what they knew they 
should have done to comply with the guidelines. 

In our study we collected data directly from clinical 
records. We found a statistically significant positive trend 
in two of four quality-of-care indicators concerning diagno- 
sis. In particular we found an improvement in the two indi- 
cators that were farthest from the standard in the pre-PGL 
group (% lesions with cytological/histological diagnosis 
before surgery and% frozen sections in < 10 mm lesions), 
but not in the two indicators that already have a good 
compliance with PGL (percent of histopathological grading 
available and percent of hormone receptor available). 

We measured two important quality-of-care indicators 
concerning the surgical treatment of breast cancer: per- 
cent of BCS in pTl lesions and percent of BCS performed 
with free margins, and the results were positive. We 
noticed a trend of improvement in the post-PGL group: 
93% of patients with pTl were treated surgically with 
BCS in the present study. We found a similar positive 
trend concerning the practice of BCS over a 5-year 
period (2000-2004) in a previous population-based 
study on women with breast cancer (all ages) carried 
out in the Piedmont Region using administrative data 
[14]. Nevertheless, the percentage of single surgery 
after diagnosis, which was already good before PGL 
were released, and the percent of reconstruction after 
mastectomy, which was extremely low, did not show a 
positive trend over time. 

The indicators regarding axillary surgery showed an 
increased proportion of patients that were treated with 
axillary clearance with a correct indication. The percent 
of patients with a clearance of > 9 lymph nodes and the 
percent of dissections not performed among CIS 
patients did not reach the standard and did not improve 
after the release of PGL. Conversely, a higher number of 



centers performed the SLN technique, with an identifi- 
cation rate that reached the standard. 

Finally, looking at the proportion of women who 
underwent SLN technique by the annual case load of the 
surgical unit, we found that the use of this technique 
increased by almost 45% from 2002 to 2004, across all 
strata of surgical unit annual caseload but in particular 
in centers treating less than 50 breast cancer a year. This 
finding is clearly in contrast with the PGL recommenda- 
tions that suggest the use of SLN technique only in 
specialized centers (surgical unit annual case load > 50). 
The increase of use of SLN technique in low caseload 
centers need to be discouraged. 

Between 2002 and 2004 the proportion of women who 
received radiotherapy after breast cancer surgery (87.7% 
in 2002 and 87.9% in 2004) was stable, though still far 
from the standard of 95%. In a previous population- 
based study in Piedmont, the presence of a radiotherapy 
unit within the same hospital where the surgical pro- 
cedure was performed was associated with a higher 
probability of receiving radiotherapy after discharge. The 
presence of a radiotherapy unit in the hospital also 
correlated with the case load and specialization of the 
surgical unit [14]. 

In the analyses of post-surgical medical treatment we 
found a decrease in the percent of patients with invasive 
lesions at medium-to-high risk of distant metastasis who 
received chemotherapy after the introduction of PGL. 
Furthermore, we observed a decrease in the percent of 
patients with invasive lesions and low risk of distant 
metastasis who received inappropriate chemotherapy. 
The percent of patients who received hormonal therapy 
was stable in the group with positive estrogen receptor 
status, and the incorrect prescription of hormonal treat- 
ment in estrogen receptor-negative women dramatically 
decreased in the post-PGL group. 

Apart from the introduction of PGL, the positive trend 
in some of quality-of-care indicators can be partly attribu- 
ted to the increased proportion of breast cancer cases 
diagnosed through the regional screening program. In fact, 
the patients who were diagnosed in the context of the 
screening program were usually referred to a surgical unit 
with a high annual case load. 

Underestimation of chemotherapy, radiotherapy and/or 
hormonal therapy was possible given that these treatments 
are administrated at a different hospital admission than that 
for the surgical treatment, or even on an ambulatory basis. 
The information we collected about post-surgical medical 
treatment was the result of record-linkages between breast 
cancer patients and the HDR database, radiotherapy out- 
patient record database and pharmaceutical prescription 
record database. Such linkages can generate omissions 
that are likely to be random, so the resulting bias would 
be conservative. 
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Finally, we did not see changes in the survival rate 
between pre-PGL and post-PGL groups. In fact, the 
majority of PGL recommendations were oriented to avoid 
invasive surgery, over-treatment, recurrence, or patient 
anxiety (i.e., avoid mastectomy in pTl unifocal, avoid 
more than one surgery after diagnosis, avoid dissection in 
CIS patients). Very few recommendations were formu- 
lated to improve survival (i.e., to measure hormonal recep- 
tor availability, to perform radiotherapy in patients treated 
with BCS, to perform axillary clearance or SLN technique 
in patients with invasive lesions). Moreover the indicators 
more related to survival, with the exception of axillary 
clearance, showed only a negligible improvement after the 
introduction of PGL. Finally it is possible that, since breast 
cancer is generally characterized by long survival, a small 
improvement in survival will manifest itself only with 
longer follow-up. 

The population-based approach of the study ensures 
that selection bias was minimal and that the results can 
be considered representative of the entire Piedmont 
Region. 

Conclusions 

The results suggest that the majority of quality-of-care 
indicators changed in the expected direction after the 
introduction of PGL, even if only 4 out of 14 reached sta- 
tistical significance. Statistical significance was registered 
in particular in the indicators that were far from achieving 
the standard. Our results highlight the need to continue 
to improve breast cancer care and to measure the correct 
adherence to PGL. 

In a previous study we evaluated the distribution, im- 
plementation and acceptance of PGL among medical 
doctors, and in the present paper we present the 
results based on quality-of-care indicators before and 
after the introduction of PGL. The ultimate evaluation 
must involve long-term outcome studies on recurrence 
and mortality to assess the real impact of PGL on 
patient care, and economic evaluations to assess treat- 
ment choices. 
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